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-The MAILING DATE of this communication appears on the cover sheet with the correspondence address - \ 
THE REPLY FILED 17 March 2005 FAILS TO PLACE THIS APPLICATION IN CONDITION FOR ALLOWANCE. 



1 . □ The reply was filed after a final rejection, but prior to filing a Notice of Appeal. To avoid abandonment of this application, applicant N 

must timely file one of the following replies: (1 ) an amendment, affidavit, or other evidence, which places the application in 
condition for allowance; (2) a Notice of Appeal (with appeal fee) in compliance with 37 CFR 41 .31 ; or (3) a Request for Continued 
Examination (RCE) in compliance with 37 CFR 1.114. The reply must be filed within one of the following time periods: 

a) C] The period for reply expires months from the mailing date of the final rejection. 

b) ^ The period for reply expires on: (1 ) the mailing date of this Advisory Action, or (2) the date set forth in the final rejection, whichever is later. In 

no event, however, will the statutory period for reply expire later than SIX MONTHS from the mailing date of the final rejection. 

Examiner Note: If box 1 is checked, check either box (a) or (b). ONLY CHECK BOX (b) WHEN THE FIRST REPLY WAS FILED WITHIN 

TWO MONTHS OF THE FINAL REJECTION. See MPEP 706.07(0- 
Extensions of time may be obtained under 37 CFR 1.136(a). The date on which the petition under 37 CFR 1 .136(a) and the appropriate extension fee 
have been filed is the date for purposes of determining the period of extension and the corresponding amount of the fee. The appropriate extension fee 
under 37 CFR 1 .17(a) is calculated from: (1 ) the expiration date of the shortened statutory period for reply originally set in the final Office action; or (2) a 
set forth in (b) above, if checked. Any reply received by the Office later than three months after the mailing date of the final rejection, even if timely filed 
may reduce any earned patent term adjustment. See 37 CFR 1 .704(b). 
NOTICE OF APPEAL 

2. □ The reply was filed after the date of filing a Notice of Appeal, but prior to the date of filing an appeal brief. The Notice of Appeal 

was filed on . A brief in compliance with 37 CFR 41.37 must be filed within two months of the date of filing the Notice of 

Appeal (37 CFR 41 .37(a)), or any extension thereof (37 CFR 41 .37(e)), to avoid dismissal of the appeal. Since a Notice of Appea 
has been filed, any reply must be filed within the time period set forth in 37 CFR 41 .37(a). 
AMENDMENTS 

3. □ The proposed amendment(s) filed after a final rejection, but prior to the date of filing a brief, will not be entered because 

(a) ^ They raise new issues that would require further consideration and/or search (see NOTE below); 

(b) O They raise the issue of new matter (see NOTE below); 

(c) □ They are not deemed to place the application in better form for appeal by materially reducing or simplifying the issues for 

appeal; and/or 

(d) D They present additional claims without canceling a corresponding number of finally rejected claims. 

NOTE: see page 2 . (See 37 CFR 1 .1 16 and 41 .33(a)). 

4. □ The amendments are not in compliance with 37 CFR 1.121. See attached Notice of Non-Compliant Amendment (PTOL-324). 

5. □ Applicant's reply has overcome the following rejection(s): . 

6. □ Newly proposed or amended claim(s) would be allowable if submitted in a separate, timely filed amendment canceling the 

non-allowable claim(s). 

7. EH For purposes of appeal, the proposed amendment(s): a) □ will not be entered, or b) □ will be entered and an explanation of 

how the new or amended claims would be rejected is provided below or appended. 
The status of the claim(s) is (or will be) as follows: 

Claim(s) allowed: . 

Claim(s) objected to: . 

Claim(s) rejected: . 

Claim(s) withdrawn from consideration: . 

AFFIDAVIT OR OTHER EVIDENCE 

8. □ The affidavit or other evidence filed after a final action, but before or on the date of filing a Notice of Appeal will not be entered 

because applicant failed to provide a showing of good and sufficient reasons why the affidavit or other evidence is necessary and 
was not earlier presented. See 37 CFR 1 .1 16(e). 

9. □ The affidavit or other evidence filed after the date of filing a Notice of Appeal, but prior to the date of filing a brief, will not be 

entered because the affidavit or other evidence failed to overcome all rejections under appeal and/or appellant fails to provide a 
showing a good and sufficient reasons why it is necessary and was not earlier presented. See 37 CFR 41 .33(d)(1). 

10. □ The affidavit or other evidence is entered. An explanation of the status of the claims after entry is below or attached. 
REQUEST FOR RECONSIDERATION/OTHER 

1 1 . 13 The request for reconsideration has been considered but does NOT place the application in condition for allowance because: 
See page 2. 

12. □ Note the attached Information Disclosure Statement(s). (PTO/SB/08 or PTO-1449) Paper No(s). 

13. □ Other: . 

Jeffery A Brier 
Primary Examiner 
Art Unit: 2672 
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Response to Arguments 

1 . Applicant's arguments filed 3/17/2005 concerning Chun et al. and Antani et al. 
have been fully considered but they are not persuasive. 

Applicants argument in the second paragraph on page 14 is not persuasive 
because the rejected claims do not claim differentiating between text that is overlaid on 
the video and text that is part of the video, for example, a sign that appears in a video 
scene. Although the claims are interpreted in light of the specification, limitations from 
the specification are not read into the claims. See In re Van Geuns, 988 F.2d 1 181 , 26 
USPQ2d 1057 (Fed. Cir. 1993). 

Applicants argue that neither Chun et al. nor Antani et al. is directed to detecting 
a potential overlay, and neither reference verifies that a potential overlay is an actual 
overlay (otherwise, text that is part of the scene would be differentiated from overlay 
text). Both Chun and Antani teach detecting text in video and since the claims do not 
claim differentiating between text that is overlaid on the video and text that is part of the 
video, for example, a sign that appears in a video scene then these two references 
teach the claimed invention. Chun teaches in section 3.2 verifying of candidates of text 
area. Antani teaches in section 2 a localization stage which uses many methods to 
localize the text. Section 2 discusses using many different localization algorithms 
whose outputs are fused in the spatio-temporal decision fusion module over multiple 
frames to verify that a potential text is text. Section 2 also discusses using a tracking 
stage, this would inherently verify the potential text is an actual text. 
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Response to Amendment 

2. The amendment filed on 3/17/2005 will not be entered. The amendment to 
claims 26-27 raises new issues because the "when executed by a computer" and the 
amendment to claim 28 raises new issues because the "when executed" may not be 
concrete enough to make the claim statutory because when the software code is not 
executed by a computer the code will be functional descriptive material that is not 
employed as a computer component. 



MPEP 2106 states with emphasis added in bold: 



1. Nonstatutory Subject Matter 

Claims to computer-related inventions that are clearly nonstatutory fall into the same 
general categories as nonstatutory claims in other arts, namely natural phenomena 
such as magnetism, and abstract ideas or laws of nature which constitute "descriptive 
material." Abstract ideas, Warmerdam, 33 F.3d at 1360, 31 USPQ2d at 1759, or the 
mere manipulation of abstract ideas, Schrader, 22 F.3d at 292-93, 30 USPQ2d at 1457- 
58, are not patentable. Descriptive material can be characterized as either "functional 
descriptive material" or "nonfunctional descriptive material." In this context, 
"functional descriptive material" consists of data structures and computer 
programs which impart functionality when employed as a computer component. 
(The definition of "data structure" is "a physical or logical relationship among data 
elements, designed to support specific data manipulation functions." The New IEEE 
Standard Dictionary of Electrical and Electronics Terms 308 (5th ed. 1993).) 
"Nonfunctional descriptive material" includes but is not limited to music, literary works 
and a compilation or mere arrangement of data. 

Both types of "descriptive material" are nonstatutory when claimed as descriptive 
material perse. Warmerdam, 33 F.3d at 1360, 31 USPQ2d at 1759. When functional 
descriptive material is recorded on some computer-readable medium it becomes 
structurally and functionally interrelated to the medium and will be statutory in most 
cases since use of technology permits the function of the descriptive material to be 
realized. Compare In re Lowry, 32 F.3d 1579, 1583-84, 32 USPQ2d 1031, 1035 (Fed. 
Cir. 1994) (claim to data structure stored on a computer readable medium that 
increases computer efficiency held statutory) and Warmerdam, 33 F.3d at 1360-61 , 31 
USPQ2d at 1759 (claim to computer having a specific data structure stored in memory 
held statutory product-by-process claim) with Warmerdam, 33 F.3d at 1361, 31 
USPQ2d at 1760 (claim to a data structure perse held nonstatutory). When 
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nonfunctional descriptive material is recorded on some computer-readable medium, it is 
not statutory since no requisite functionality is present to satisfy the practical application 
requirement. Merely claiming nonfunctional descriptive material stored in a computer- 
readable medium does not make it statutory. Such a result would exalt form over 
substance. 

The amendment to paragraph 0034 would overcome the objection to paragraph 

0034. 

Allowable Subject Matter 

3. Claims 4-21 remain objected to as being dependent upon a rejected base claim, 
but would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. Claim 28 would be allowable if rewritten to 
overcome the rejection(s) under 35 U.S.C. 112, 2nd paragraph, set forth in this Office 
action and to include all of the limitations of the base claim and any intervening claims. 

4. Claims 29-34 remain allowed. 

5. The following is a statement of reasons for the indication of allowable subject 
matter: 

Claims 4-21 and 28-34: 

The prior of record fails to teach or suggest detecting the potential overlay by 
using wavelet decomposition on the video sequence, extracting features based on the 
wavelet decomposition, and performing neural network processing on the extracted 
features. 
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6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jeffery A Brier whose telephone number is (571 ) 272- 
7656. The examiner can normally be reached on M-F from 7:00 to 3:30. If attempts to 
reach the examiner by telephone are unsuccessful, the examiner's supervisor, Michael 
Razavi, can be reached at (571 ) 272-7664. The fax phone Number for the organization 
where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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Primary Examiner 



Art Unit 2672 



